Educational Research 


extensive testing program with its implications regarding 
pupil development and curriculum efficacy. The school 
which the testing was done one the thirty schools 


co-operating the Eight-Year Study the Progressive 
Education Association. The tests used are some those 
devised the members the Evaluation Staff co- 
operation with committees teachers the thirty schools. 


Newer Conceptions Evaluation 
concept integration has come into the field 


educational measurement. evaluation program 

which grows out educational philosophy that 
emphasizes integration must itself guided integrating 
principle. Hence, the plan evaluation should not depend 
upon the present availability instruments, the chance desires 
the officers the institution, the vested interests persons 
within some subject-matter areas, the prejudices needs the 
school administrators, the comparability the results with 
other institutions, and forth. Instead, evaluation should 
part the educational plan, and the problems met that 
program should analyzed search for new means 
evaluation. 

The program evaluation should based upon the phil- 
osophy that expressed the purposes the institution con- 
cerned, which are presumed operating all activities 
the school. The plan evaluation should satisfy school-wide 
purposes, and the various tests, records, and other evidences 
should have value for teachers and pupils, and the data should 
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serve the guidance officer, the principal, the parents, and 
society generally. 

The term “integration” itself implies number factors 
relation the personality students. educational policy 
based upon that principle will not confuse partial evidence with 
that more comprehensive sort. Before the concept inte- 
gration came into the field education, there was tendency 
isolate tests from the curriculum, and both from the develop- 
ing changes the boys and girls who attended school. Even 
today general practice consider evaluation something 
extra and something that comes after teaching and problem 
that can solved independently from education generally. 
this connection pleasure note that the thirty schools 
participating the Eight-Year Study the Progressive Edu- 
cation Association have accepted much more comprehensive 
concept evaluation. 

During the current school year most the experimental 
schools have initiated evaluation program which wide 
scope and related directly the purposes, namely, the phil- 
osophy the program, and which directed toward some 
the changes which are taking place high-school students. The 
students have shared frequently the determination these 
purposes; they have participated willingly the evaluation 
program; they have expressed appreciation for the helpfulness 
the diagnoses which resulted from interpretation the data. 

one should attempt classify all the objectives which 
have been expressed students, teachers, and administrators 
who are participating this Eight-Year Study, multitude 
classes would result. The scheme which follows convenient 
outline for the purpose relating the evaluation devices each 
heading, and expressed terms which are familiar the 
teachers the experiment. There seems be, according 
this classification, eight rather large areas: functional informa- 
tion; aspects thinking; attitudes; interests, aims, purposes, 
appreciation; study skills and work habits; social adjustment 
and social sensitivity; creativeness; and functioning social 
philosophy. 

Descriptions the objectives terms student behavior 
have been made many articles and are available the form 
bulletins which are distributed the Progressive Education 
Association. Methods evaluation relating each these 
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fields are available the same source. These vary quantity 
from field field and also quality, but serve validly the 
purpose securing more information about the student re- 
spect many characteristics personality. 

Where the purposes educational institution have been 
rather clearly formulated, the selection experiences for teach- 
ing and learning have much sharper direction, and the matter 
evaluation teachers much easier task. The observa- 
tions teachers are related the behavior students with 
respect these purposes, and evaluation more less con- 
tinuous process. this true, the question might well 
asked, create such comprehensive program evalua- 
tion when the teachers themselves have all the information per- 
taining individuals?” 

This may not the place into lengthy defense 
inaugurating program evaluation. few points might 
mentioned: possible develop methods evaluation 
which will provide teachers with realistic pictures student 
development; these devices can economically administered 
terms time with respect both teachers and students; and 
the resulting evidence gives the teacher bases for directing 
the development these students, then the program might 
acknowledged valid contribution educational activities. 

the report which follows, the results evaluation 
program one high school are presented. large measure the 
inferences drawn with respect individual students and 
classes were concurred teachers and other guidance 
cers. These alone, course, not validate the tests. Nor 
the results validate teachers’ judgments, such. The reader 
must keep mind, however, that the school selected for this 
study the teachers were intimately acquainted with the progress 
their students number objectives. And this not 
say that these results were value these particular teach- 
ers personally. The diagnoses which were made from the data 
were valuable even these teachers, according their own 
testimony. Moreover, believed that many teachers who 
have not had the chance know their students thus intimately 
will able profit similar testing program and will have 
results somewhat comparable the evidence which otherwise 
would have taken several years accumulate. With this back- 
ground may forward consideration the data. 
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Evaluating the Program 
Lakeshore School 


obvious reasons, reasons that soon will become ob- 
the real name the school discussed this 

article not used. Lakeshore School private 
school, coeducational, and made students drawn from 
wide variety occupations far their parents are concerned, 
and intelligence slightly above the median normally expected 
the typical public school measured scores the Ameri- 
can psychological examination. The teacher-pupil ratio the 
Lakeshore School 15. The quality the instruc- 
tional staff high terms their training, their interest 
their students, their concentration achieving educational pur- 
poses which they have rather clearly formulated, and terms 


their desire improve the total educational situation their 


community. 
The administrative staff the school and the teachers have 
been working for number years determining the objec- 


tives the school and reconstructing the curriculum that 


these objectives may more fully realized. The relationships 
between teachers and pupils are kind which insures pupil 
purposes being considered the program. number the 
teachers have participated the Summer Workshops conducted 
the Progressive Education Association and have worked 
their curriculum problems co-operatively that the school- 
wide objectives have received particular emphasis all the 
teachers concerned the programs. 

The students the Lakeshore School may select one four 
different curriculums. making their choices, they have the 
benefit the guidance teachers who act advisers and who 
have each had experience building the curriculum and 
guidance. The curriculums are organized about science and 
mathematics, literature and language, social studies, and civics. 
The last-named choice arranged for those students who are 
not preparing for college, and the curriculum conceived 
broadly citizenship-training program. Sciences, mathemat- 
ics, literature, and the fine arts are electives for this group 
students. every curriculum, provision made for students 
wishing elect additional courses which lie outside the par- 
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ticular group studies they have elected. Choices made stu- 

dents are not final; they may changed the end year 

and sometimes the end two years. 

The evaluation data presented this report refer only 
students the upper three grades the school. The various 
tests were chosen committees teachers who agreed that 
they represented instruments which got some the impor- 
tant objectives their teaching. The evaluation incomplete 
the sense that there are significant aspects student achieve- 
ment which have been omitted. These include such character- 
istics student development industry, the student’s tendency 
plan his activities, the student’s health, his ability get along 
with others and adjust well variety situations, and the 
like. Notwithstanding this fact omissions, the program herein 
reported much more comprehensive evaluation than was 
ever attempted the Lakeshore School before. must also 
remembered that this school the advisers students have 
much additional information relating the items already men- 
tioned and also the student’s home background, his voca- 
tional interests, his collegiate choices, and his grasp the 
important information and basic skills required most the 
course work. 

selecting the present battery testing instruments, the 
faculty the school set the following criteria guide their 
choices: 

Each test should measure some abilities which cut across courses 
subject-matter. 

Each ability measured should important the lives students and 
not restricted exclusively academic work. 

Each ability tested should one that capable continuous growth 
and not something that could learned few days the great 
majority students. 

The tests should sufficiently diagnostic “point” probable reme- 
dial measures. 

The tests chosen should concerned with problems which are im- 
portant social living today. 

The tests should reliable, valid, and accurate measures the objec- 
tives which the teachers have set up. 

Tests selected should give the teachers some light the success with 
which they have guided students into these four curriculums. 


With these criteria mind, the teachers selected some 
evaluation instruments which would give them some data 
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relevant certain aspects thinking, the interests their 
students, the attitudes their students, and certain aspects 
appreciation literature. The results the various tests 


TABLE 


PERCENTAGES DESIRABLE AND UNDESIRABLE INTERPRETATIONS 
Data 
(All Numbers Are Percentages Total Opportunities the Test) 


UNDESIRABLE 


Civics 


Language and Literature 
Mathematics and Science* 
Social Science 


This curriculum was organized two years ago, and there was twelfth-grade group 
the time writing. 


Key Column Headings: 
A—General accuracy with respect all statements the test. 
B—General accuracy with probably true and probably false statements. 
C—General accuracy with statements based insufficient data. 
D—Going beyond the data. 
E—Going beyond the data the direction ascribing more truth than warranted. 
F—Going beyond the data ascribing greater falsity than the data warrant. 
G—Confusing probably true with probably false, true with false, vice versa, crude 
errors judgment. 


each these areas are presented the accompanying tables. 
What follows this article will description the inter- 


pretations these results made these teachers and, some 
instances, explanation extremely high low scores. 
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SHALL first consider the scores these students 
thinking test which deals with the interpretation data. 
Eight the statements which form part one the ten 
problems which this test made, are reproduced here, to- 
gether with the directions the student. 


When read, study, listen, observe, usually are trying 
get ideas meanings. other words, are trying “interpret” 
“to draw inferences” from the data. 

This test see how well you can draw inferences make inter- 
pretations from facts which are presented you. Some these facts are 
related social problems such production, the national budget, wages, 
etc. Some other exercises are related the field science. 

Below each exercise have listed number statements which 
might called “interpretations” “inferences” drawn from the facts. 
want you study each these interpretations very carefully and 
judge them according the standards which follow: 

the interpretation fully supported the facts given that you could 
say that was true? 

the statement supported the facts given the extent that you 
could say was probably true? 

the statement one for which the facts given are very insufficient, 
making impossible for you judge one way the other? 

the facts which are given suggest that the statement probably 
false? 

the facts which are given contradict the statement that you can 
say that false? 

EXPENDITURES THE FEDERAL GOVERNMENT 
(In Thousands Dollars) 


Purpose 1910 1920 1936 

Research, education, and development 
Public debt (interest) 22,583 929,131 1,153,000 
Pensions and care 162,568 329,261 576,000 
Obligations arising from World 

Total Federal $639,502 $5,687,712 $8,880,000 


Included Primary Functions. Included under other headings. 
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Statements— 

82. More money will spent the primary government functions 
1939 than was spent 1936. 

83. About third government expenditures for 1936 went for relief. 

84. The United States government borrowed heavily between 1910 and 
1920. 

85. The national debt was lower 1936 than 1920. 

86. The government spent money public works 1936. 

87. More money was spent the Navy 1936 than 1920. 

88. Interest paid the debt 1920 was over times great 

89. The primary costs government increased every year from 
1936. 


reader directed, first, notice how the materials are 
organized within Table The curriculums are kept to- 
gether and reported separately for Grades XI, and XII. 
each table, medians for the whole grades are recorded and these, 
course, include the scores all the children all the differ- 
ent curriculums for each grade. These tables were organized 
this fashion for the following reasons: First, the teachers 
wanted compare the different grades within each curriculum 
see there was continuity growth the different abilities 
from year year. Second, they wanted compare the differ- 
ent curriculums, grade grade, see there were significant 
differences between them with respect the various abilities 
tested. Third, the teachers wanted see the complete results 
single test described one table that they might have 
the opportunity see high and low spots within the school. 
Fourth, the teachers wanted the complete data presented that 
they might read across the table and notice differences the 
pattern achievement from group group grade grade. 

The median percentages desirable interpretations social 
data are given for Grades XI, and XII Columns and 
Table the undesirable interpretations are listed Col- 
umns With these guides interpretation mind, 
may notice the table, general, that the civics curricu- 
lum represented lower scores each the desirable areas 
and higher scores the undesirable areas. notice par- 
ticularly inability the part these students recognize 
interpretations data which are only “probably true” “prob- 
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ably false,” other words, those interpretations which are 


based upon insufficient evidence, and see much lower 
ability Grades and recognize the limitations the 
data (see Column 3). general, the students the social- 
studies curriculum made higher scores the desirable aspects 
this test than did students the other courses study. This 
superiority also shown the lower scores the undesirable 
characteristics. The students the mathematics and science 
curriculum Grade were high their achievement and 
sharply different this respect from the students Grade 

When this distinctive difference between the two grades was 
discussed with the teachers the school, there appeared the 
illuminating fact that the students Grade were studying 
mathematics which focused upon aspects thinking they 
relate problems everyday life. The teachers these 
students feel quite confident that this distinction the curricu- 
lum might well explain the difference scores the two grade 
groups. There seems greater growth from Grade 
Grade XII, represented these scores, than from Grade 
Grade XI. Here again, the curriculum emphasis now 
effect seems explain partially this feature the results. The 
teachers Grade and Grade XII are giving greater empha- 
sis the achievement the abilities involved this test than 
are those teachers who give major portion their time 
students Grade XI. general, the entire school indicates 
lack ability discriminate among those interpretations 
which agree conflict with established trends the data pre- 
sented, and the students are also insecure their handling 
interpretations which are really based upon insufficient evidence. 

pertinent note that this particular test dealt with 
social-science data and that, general, the students the social 
studies achieved higher scores than students the other cur- 
riculums. The teachers felt that the curriculum itself might 
explain this extra achievement and pointed out that when the 
data were scientific nature, they had evidence show that 
students the science curriculum did best all the courses. 
their general accuracy interpreting data, the students 
did much less well than the teachers expected them (see Col- 
umn 1). Before considering whether not give increased 
emphasis this particular ability interpret, the teachers, 
course, wanted refer scores made other tests. 
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The reader will notice that the scores for individual stu- 
dents have not been presented. The addition tables which 
would include results every student every test would pro- 
long the article such extent that publication single 
would impossible. The methods for interpreting 
the scores made individual boys girls may the basis for 
another article relating the results achieved the School. 


Table have the results second test relating 
thinking. This one deals with the abilities students 
apply principles logic social problems. Some the prob- 
lems deal with school situations, some with the decisions 
public utilities, some with governmental policies, and the like. 
One the thirteen problems, which this test comprised, 
reproduced here show the general form the test: 


man vacationing resort hotel was asked the manager the 
hotel pay his bill. was unable so, the manager kept the 
man’s automobile which had been put the hotel garage, claiming that 
had right this under law which allows hotels keep the 
baggage guests until their bill paid. The owner the automobile 
took the matter court. 

Assume the statements this story true. 

Directions: Below are three conclusions—A, and Choose the one 

which you believe most consistent with the facts stated above. 

The hotel manager may keep the automobile until the bill paid. 
The hotel manager may not keep the car until the bill paid. 
Further information needed before possible say whether 

not the hotel manager may keep the car until the bill paid. 

Reasons— 

Since cost the hotel money have the man stay there, the hotel 
manager should allowed keep the car until the bill paid. 

need have the meaning “baggage” defined law. 

would need know the amount the bill and the value the 
car. 

the automobile probably worth much more than the amount 
the bill, the hotel manager should not allowed keep it. 

need clear-cut definition “resort hotel.” 

changed definition will produce changed conclusion although the 
argument from each definition logical. 

The conclusion not necessarily true, but accept the assumptions 
which argument based, then logical should accept the 
conclusion which follows logically from them. 
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The soundness indirect argument depends upon whether all the 
possibilities have been considered. 


this test the students were given opportunity show 
their understanding and their ability apply the four fol- 
lowing principles logic: first, the so-called “if then” prin- 
ciple. the situations presented, the student asked agree 
with certain fundamental premises and then choose con- 
clusion which consistent with these premises. second 
part the test, asked give reasons for his choice 
conclusion, and here expected give the logical principles 
involved. Second, vague definitions are presented. some 
situations, solution impossible until certain words phrases 
have been fairly defined. The student expected recognize 
that solution impossible, and expected indicate, 
reasons for that decision, the words and phrases which need 
more careful definition. The third principle “the indirect 
argument.” Three the problems the test contain examples 
the indirect argument; conclusion drawn after consider- 
ing three alternatives, ruling out two them, and then decid- 
ing that the remaining one must, therefore, logical. Besides 
recognizing that this does not constitute proof, the student 
expected justify the assertion indicating the reasons which 
would illustrate the shortcomings the particular argument. 
The fourth principle “ridicule-abuse.” three the prob- 
lems, name-calling, ridiculing, and forth, are resorted 
the participants the situation, and the students are expected 
recognize that this does not constitute proof disproof. The 
student also expected tell why holds this opinion. 


THE picture the entire school given the last three rows 
Table II, see that with respect each principle there 
higher score from Grade through Grade XII. 
The school, whole, seems strongest recognizing 
words and phrases which need more careful definition, and rec- 
ognizing that ridicule and abuse are not proof disproof. The 
scores indirect argument are lower than these, while the 
scores the “if then” principle are lowest all. The students 
the literature and language courses have outstanding total 
scores when compared the other curriculums, and their scores 
each grade are highest. The students the civics curriculum 
generally have the lowest scores, except those Grade 
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TABLE 


TEST 


LoGic 


(1) (2) (4) (5) (6) 
Civics 


Language and Literature 


Mathematics and Science* 
Social Science 
Total Grade Group 


This curriculum was organized two years ago, and there was twelfth-grade group 
the time writing. 
Key Column Headings: 

the tendency students recognize and apply so-called “if then” prin- 
ciples; understand that certain premises are accepted then the conclusion which 
follows from those premises must also accepted. 

B—in some situations solution impossible unless certain words phrases are 
defined. this test three such situations were presented, and the scores the 
tendency the student see that the problem could not solved certain 
words phrases were defined. 

the so-called “indirect The scores reveal the ability student 
detect when all the possible alternatives have not been considered. 

D—refers the tendency some people use vituperation, abuse, and other forms 
name-calling with the idea that constitutes proof. 


indirect argument; here they seem well, better, than 
students the other courses. The students the social studies 
and mathematics curriculums Grade had the highest 
scores; this, too, may due the emphasis their teachers 
the aspects mathematical thinking mentioned earlier 
section this 


See footnote page 69. 
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The teachers social studies were the opinion that they 
had given insufficient attention the presentation social- 
problem situations with their students, and they thought that 
renewed emphasis this phase their curriculum might bring 
about quite change the scores before the next testing period. 
The teachers the literature and language curriculum believed 
that their concentration upon analysis personal and social 
relationships their courses was largely responsible for the 
superiority shown their students this examination. 


THIRD aspect thinking revealed test concerned 
with certain aspects proof. this examination, stu- 
dents were given situation wherein conclusion had been 
drawn. They were asked indicate the important assumptions 
upon which this conclusion was based. They were asked also 
organize proof leading that particular conclusion and 
doing utilize whatever was necessary from certain data 
which were presented. Sections the test are reproduced here: 


small piece magnesium will ignite and burn with bright light 
atmosphere chlorine gas, leaving white ashes. Bill secured some 
chemicals, which when mixed together and heated, gave off colored 
gas. collected some this gas bottle. The chemistry teacher 
gave him small piece magnesium. Bill put the bottle colored 
gas. The magnesium ignited, burned with bright light, and left white 
ashes. Bill told his friends that his results conclusively proved that the 
colored gas was chlorine. 


Part 
Are You Learning Distinguish Facts from Assumptions? 

Directions: All the statements below are related some way the 
situation concerning the chlorine-gas experiment. Suppose, for the mo- 
ment, that you, personally, had been present that situation. Under 
those circumstances you would have accepted some the following 
statements matters-of-fact. Some them, however, you would have 
open doubt, that may may not true, and which, this par- 
ticular situation would not acceptable fact. Which statements 
the list you regard “assumptions.” 


. . . . . . . . . 


study the intelligence-test scores reveals significant differences the 
medians the respective curriculum groups, with the exception the students the civics 
course study, whose scores the American Council Psychological Examination are 
lower than those other curriculums. This also true with respect their scores 
the Iowa Silent Reading Test. 
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Chlorine not the only gas which magnesium will ignite, burn 
with bright light and leave white ashes. 

The material the chemistry teacher gave him was magnesium. 

Chlorine gas the only gas which magnesium will ignite. 

Chlorine gas the only gas which magnesium will ignite, burn 
with bright light, leaving white ashes. 

Bill mixed and heated some chemicals which gave off colored gas. 

small piece magnesium will ignite and burn with bright light 
atmosphere chlorine gas, leaving white ashes. 


Part 

Are You Learning Recognize the Assumptions Necessary for Proof? 
Directions: Read over again those statements which you have marked 
“assumptions.” you were trying prove that the gas was chlorine 
you would make use the available facts, but would also necessary 
for you make use some these assumptions. this particular 
situation two the assumptions are very important the logical proof. 
Which two would you choose most important? 


Part 
Are You Learning How Develop Logical Proof? 

Directions: When arguments for against some proposition are pre- 
sented newspapers, magazines, speeches, textbooks, often feel 
that the discussion could have been made more logical. Authors some- 
times put statements that are really unnecessary prove their point; 
other times they leave out important arguments; other occasions 
they sometimes include statements which actually contradict their own 
conclusions. what follows try not make any these errors. 

Suppose you were describing this experiment and that you were 
trying prove that the gas was chlorine. What are all the absolutely 
necessary steps the complete development the proof? Use many 
the statements the list you think are Write their let- 
ters the space below. 


The scores Table III indicate the number critical as- 
sumptions recognized different groups within the school. 
The table also shows analysis the proof submitted each 
section within the school, and reveals the median number 
facts, the median number critical assumptions, and the num- 
ber conclusions included each proof. interesting 
observe that there almost difference with respect Grades 
XI, and XII each these aspects the examination. 
When this was discussed meeting teachers, there were 
many comments the effect that their daily work they had 
neglected give much emphasis this particular aspect 
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thinking and that these results would confirm their own judg- 
ments about what might expected the different grades. 
The only other significant item the test revealed the 
achievement the eleventh-grade students the mathematics 
and science curriculum. These students consistently achieved 


TABLE 


Critical 


Recognizing 


(1) (2) (3) 
Civics 
Language and Literature 
Mathematics and Science* 
Social Science 
Total Grade Group 


This curriculum was organized two years ago, and there was twelfth-grade group 
the time writing. 
superior scores, and was these particular students who were 
studying the new kind mathematics, which was focused 
largely upon the thinking closely related analysis for implicit 
assumptions. Here again, the results the test coincided large- 
with the teachers’ judgments the accomplishment 
expected the students. 


the teachers, who were much interested secur- 
ing some evidence about the interests their students, 
developed questionnaire which yielded some evidence this 
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point. Ten items the three hundred items the Interest 
Questionnaire are reproduced here, together with the directions 
and the scheme student evaluation. 
DIRECTIONS 

This questionnaire devoted entirely the interests which have been 
shown high-school students. want you indicate whether you 
like activity, are indifferent it, dislike the activity. After you 
have made this decision, want you state whether you have had any 
experience doing this activity. Finally, want know you would 
like some opportunity more opportunities than you now have. 


means “like” means “had experience” 
means “indifferent to” means “want some opportun- 
means “dislike” ity more opportunities” 


13. work science laboratory. 

14. listen the reading story. 

15. along with large group who are planning attend movie, 

16. read about particular scientific developments, like the use and 
purpose the new cyclotrone (atom smasher), the use X-rays 
examining pipes and the various uses the “electric eye.” 

17. draw paint. 

18. read books travel. 

19. ride horseback. 

20. study about what our government doing. 

21. make good English translations Latin authors. 


22. construct draw geometrical other designs with rulers, com- 
pass, and triangle. 
23. attend school games whenever possible. 


The results from this interests questionnaire are classified 
Table IV, and the headings the columns are self-explanatory. 
The numbers indicate the percentage the activities each 
the areas which the student reported interest and which 
believed had the ability excellent work. terms 
the school whole, the lowest interests were found 
the field language and literature, and the highest interests 
shown social problems and science and engineering activities. 
The students the different curriculums expressed interests 
this questionnaire which coincided largely with their choice 
curriculums. The boys and girls the civics curriculum showed 
much higher interest activities relating the arts than was 
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expected; this was quite surprise their teachers. The pres- 
ent curriculum these students heavily loaded the aca- 
demic side, and their teachers report the dissatisfaction many 
students with the academic work required them. The 
teachers are now investigating the possibility enriching the 
curriculum with many activities related fine arts for these 


TABLE 


PERCENTAGE “INTEREST IN” AND “ABILITY 
ExcELLENT Work” 


Types INTERESTS INDICATED 


Civics 

Language and Literature 
Mathematics and Science* 
Social Science 


This curriculum was organized two years ago, and there was twelfth-grade group 
the time writing. 


Key Column Headings: 


I—Language 


II—Science and engineering 


IV—Social problems 


V—Mental activities 
VI—Manipulative activities 
tendencies 

tendencies 


students. Those the social-studies curriculum seem have 
well-balanced interests, for they score high all aspects the 
test. The low interest scores language shown the students 
majoring science and mathematics were thought due the 
type English courses these students were taking—courses 
which were concentrated largely formal composition and 
reading the biographies eminent scientists and engineers. 
The teachers were the opinion that reorganization the 
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courses might well attempted because the discouragingly 
low interest revealed these students. 


TABLE 


APPRECIATION 


APPRECIATION 
Groups 


Civics 


Language and Literature 


Mathematics and Science* 


There was twelfth-grade group the time writing. 
Key Column Headings: 
I—the liking for general reading. 
desire for more general reading. 
individual’s curiosity about his general reading, authors, setting, characters, etc. 
aspects appreciating his general reading; namely, dramatizing scenes, 
sketching characters, and the like. 
V—the tendency the student identify himself with plots, scenes, characters, and 
forth his general reading. 
tendency the student relate the problems found his reading life 
problems around him. 
desire the student evaluate his general reading terms style, color, 
characterization, and the like. 
score and represents composite the first seven groups. 


seven columns Table which record the results 
appreciation test are devoted the seven following 
objectives: student’s appreciation revealed his liking 


Social Science 
Total Grade Groups 
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preference for reading leisure-time activity indicates 
some degree his enjoyment the activity reading (Column 
2). His appreciation measured his desire have more 
time for reading, read more books various kinds, and 
have greater share his leisure time devoted activities 
relating reading (Column 3). His appreciation gauged 
his curiosity know more about authors, books, settings, char- 
acters, techniques writing, and the like (Column 4). His 
appreciation indicated some degree his desire partici- 
pate such creative activities dramatizing certain scenes, 
sketching certain characters, re-writing certain parts the entire 
story sequels the story, translating into any other 
medium the feelings which were invoked his reading (Col- 
umn 5). The student may show his appreciation his identi- 
fication himself with certain characters, the plot, scenes 
(Column 6). relating what has read his own per- 
sonal problems and seeing relationship between the characters 
book and people whom knows, shows his appreciation 
(Column 7). His appreciation revealed his desire evalu- 
ate the plot, the use words, literary techniques employed 
the author, and the like what has read (Column 8). 
The total score all these categories when combined repre- 
sents the percentage responses which could interpreted 
revealing the student’s appreciation (Column 9). 

The first three items from the seven parts the test used 
evaluate appreciation are included here. The students were 
asked answer yes, no, uncertain. 

PART 
you ever recount other people any scenes, incidents, ideas 
encountered your reading which you have found especially inter- 
esting? 
general, you find the activity reading more less distasteful? 
you spend relatively large amount your free time reading? 
PART 
you ever re-read certain pieces literature—or parts pieces 
literature—which you have previously read and enjoyed? 


you ever read, rather close succession, several pieces writing 
the same author? 


you ever seek out and read other pieces literature which are 
more less similar ones which you have already read and enjoyed? 
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PART 

you ever attempt state your own words, either orally 
writing, the meanings which you feel you have discovered par- 
ticular piece literature which you have read? 

you enjoy talking other people about their interpretations 
particular pieces literature which you also have read? 

you generally avoid attending lectures, movies, literary meetings, 
which are concerned any way with the lives works 
authors? 


PART 
you ever wish that you yourself might have written particular 
piece literature which you have read and enjoyed? 
you read, you attempt picture clearly your imagination the 
persons, places, situations, actions, etc., depicted the writer? 
writing, for you, natural and frequent outgrowth your reading, 
both intellectual activity and source pleasure? 
PART 
Does the literature which you read ever remind you persons, scenes, 
situations, etc., real life which seem you strikingly similar those 
described the thing being read? 
Would very unusual thing for you ever make use any 


literary allusions your own speech writing? 

your own reading, you ever feel that you yourself are actually 
particular character the thing being read, experiencing your 
imagination exactly what the character himself supposed ex- 
periencing reality? 


PART 

you feel that your own ideas about life are generally influenced 
very little your reading literature? 

you ever feel that you would like talk the author about cer- 
tain the personal social problems raised particular piece 
literature which you have read? 

you ever feel the necessity having more information about cer- 
tain the personal social problems raised particular piece 
literature which you have read? 

PART VII 

you regularly attempt evaluate new pieces literature which 
you read terms the acceptableness their conclusions? 

you ever consult published criticisms the various pieces litera- 
ture which you read? 

you ordinarily read new pieces literature without giving any 
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thought the nature seriousness either their merits their 
defects? 


study the achievement each grade shown 
Table notice that generally there are higher scores 
Grade XII than Grade XI, and Grade than 
Grade might infer that there increase apprecia- 
tion students move through the grades. This true not only 
for the school whole, terms grades, but also for each 
with but few exceptions. Notice, too, that the students the 
twelfth grade the social-studies curriculum have the highest 
scores appreciation rather consistently throughout the table. 
This agrees with the teachers’ judgments about this particular 
group. Over period years these students have evidenced 
high appreciation literature, and the teachers themselves 
would rank this group above those who are majoring lan- 
guage and literature. Note again that the students enrolled 
mathematics and science showed the lowest scores apprecia- 
tion nearly all aspects the questionnaire. Some mention 
was made this preceding paragraph where was pointed 
out that these students have had program literature which 
quite different from students enrolled the other courses 
study. With the single exception students mathematics 
and science, again note that the civics majors have lower 
scores than the students enrolled the other two curriculums. 
The school, whole, consistently showed lowest scores 
the aspect which identified “creative activities relating 
appreciation” (see Column 5). These findings are also sub- 
stantial agreement with what the teachers report concerning 
the students’ behavior which reveals appreciation. High scores 
were shown the students their general liking for the litera- 
ture which they are now reading, and high scores were also 
shown Column which seems reflect the students’ desire 
have more time and more opportunities for the enjoyment 
reading. 
Similarly, the scores Column are high, and these show 
tendency the students relate their reading the activities 
which are part their everyday life. mention has been 
made comparing the results the tests this particular 
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school with those achieved corresponding grades other 
schools, but this instance must recorded that these scores 
representing appreciation literature are much higher than 
those found many the schools where these same testing 
instruments have been used. 


GET some measure the attitudes which students held 
toward business, family, race, politics, and religion, Scale 
Beliefs was administered all students the upper three 
grades. The first ten the ninety-three items the Scale 
Beliefs are given here. The student was asked indicate his 
agreement, disagreement, and uncertainty concerning the items. 


democratic form government can satisfactorily adapted 

the needs our times. 

The Supreme Court should declare unconstitutional any law which 

does not conform the letter and word the Constitution. 

should buy only American goods whenever they are available. 

Even democracy, many governmental positions should filled 
appointment rather than election. 

The Constitution must preserved without amendment. 

rule, wars bring permanent benefits the winning nation. 

Wars and preparation for war develop people, whole, noble 
qualities such sturdy manliness and courage. 

the interests our country clash with the interests humanity 
throughout the world, our first loyalty should humanity rather 
than our country. 

The greatest men our nation’s history are the generals and ad- 
mirals who have won victories times war. 

10. citizen renders greater service for his country when fights for 

social justice for his fellow citizens than when goes war. 
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Table are recorded the scores the different grades, 
classified according liberalism, uncertainty, conservatism, and 
inconsistency. record the scores each aspect the test 
for each the grades and for each the curriculums would 
have unduly complicated the table this report. 

Column the table are recorded the scores represent- 
ing liberalism expressed students their answers the 
attitude test. The reader will note that every curriculum 
group there increase liberalism through Grades 
and XII. This consistency expression is-not found Col- 
umn which represents the degree uncertainty. The least 
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uncertainty shown students the civics curriculum, with 
the exception Grade XI; the higher uncertainty shown 
students the eleventh grade the mathematics and science 
curriculum, and the tenth-grade students the social-studies 
curriculum and the eleventh-grade students the civics cur- 
riculum. Outside these, there seems little variation 
from grade grade from curriculum curriculum with 
respect the amount uncertainty. Also, there little varia- 
tion the scores which represent conservatism Column 


TABLE 


TOWARD 


(1) (2) (3) (4) 
Civics 
Language and Literature 
Mathematics and Science* 
Social Sciences 


This curriculum was organized two years ago, and there was twelfth-grade group 
the time writing. 
The amount inconsistencies, shown Column reveals 
growing consistency outlook through Grades XI, and XII. 

The school, whole, shows surprising liberalism, 
reflected the scores made this particular test. The students 
the social-studies curriculum stand highest this respect 
when they are compared with students other curriculums, 
grade for grade. These high scores were revealed almost 
every one the categories included the test—business, 
family, race, politics, and religion. The highest scores for liber- 
alism were found the categories politics and 


EDUCATIONAL RESEARCH BULLETIN 


race; this was followed closely high liberalism toward 
business. The students were most conservative with respect 
their beliefs relating the family, and next that, religion. 
Related their more conservative scores the field the 
family and religion were proportionately higher inconsistencies 
their test results. the area race relations, they showed 
surprisingly consistent results, and this clarity outlook was 
also shown their replies questions politics. The students 
seemed less consistent business relationships than 
matters family and race. When the total scores the entire 
grades for the Lakeshore School are compared with results 
achieved other schools, the students reveal themselves 
much more liberal and much more consistent than the students 
the typical high school which has included this type test 
its evaluation program. 


Interpretations Data 
Hus far number tables have been presented which 


show the median scores made the students enrolled 

the different curriculums the different grades 
certain aspects five tests. the total evaluation program 
this particular school, ten different tests were administered. 
Lack space prohibits the inclusion additional tables and has 
limited the interpretations each table, but perhaps might 
wise devote some space consideration ways which 
this mass data was interpreted the teachers and the writer 
co-operation. 

With the ten tables data spread out before large 
table, began study them—one table time. had 
stack 5-inch cards, and followed the guides 
enumerated the beginning this article. noticed whether 
not there was continuous growth from grade grade shown 
the scores. there was any significant fact regarding par- 
ticular grade the school shown the scores, jotted 
down card, and headed that card with distinguishing 
note. Next, considered particular curriculum see wheth- 
not there was any significant change from grade grade 
that course study. This noted separate card either 
for the entire curriculum for particular grade within the 
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course study. Then, compared the four curriculums with 
each other each grade, and anything significant was shown 
this comparison, was jotted card. Finally, looked 
all the tables for significant strengths weaknesses the 
entire school organization, and where found any, jotted 
them down card. 

When had completed this task for all ten tables, had 
more than 100 cards. These sorted grades, curricu- 
lums, curriculums within grade, and items which re- 
ferred the entire school. This gave body data from 
which could draw generalizations about particular curricu- 
lums, about particular grades, about the entire school. 
wrote the inferences which were possible from study these 
data down sheets paper. These inferences were then 
checked carefully all members the co-operating groups, 
because intended report them the faculty, and 
wanted able substantiate each them the test 
records. When this had been done, then had meetings 
the teachers the different curriculums and presented them 
our findings. almost every instance significant record, 
found substantial agreement with the judgments the 
teachers concerned. these meetings, the teachers raised 
questions about probable measures which they might take 
compensate for some the acknowledged deficiencies the 
students these abilities which were recognized the common 
purposes the 

several cases, teachers decided that, notwithstanding the 
fact that low scores had been made, the moment nothing 
should done bring these scores up. The most significant 
areas were selected for immediate emphasis, and others left 
either until later for more thorough investigation see 
whether not additional data would agree with the findings. 


NTERPRETATIONS the results individual students were 

much more illuminating than the facts which were shown 
concerning the different courses study the different groups. 
almost every one the tests, individuals revealed surpris- 
ingly different patterns achievement. This was true 
accomplishment the test relating the interpretation data, 
the attitudes scale, the interests questionnaire, and the other 
tests dealing with thinking and appreciation. Where particu- 
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lar grade group was composed about students, something 
significant could reasonably said the achievement more 
than those students each test. The reader will recall 
that the description the school, mention was made the 
high type guidance which was found operating. The teachers 
knew the students intimately. The system records and re- 
ports was excellent one and contained much significant infor- 
mation about each student the school. 

One the tests the validity the evaluation program 
came when the teachers asked the writer describe students 
them the basis the test results, see that description 
would check with their own knowledge him. The writer was 
asked this job, not for few students, but for many stu- 
dents; did not with one two teachers, but with fifteen 
twenty. did with teachers who had only few students 
under their supervision, and with teachers who had seventy-five. 
The teachers were amazed find their own judgments, which 
were the result experiences with the students extending over 
several years, substantial agreement with those the writer 
who knew these students only their test records. 

The records several students were found which were 
quite out harmony with the scores the groups which 
they belonged, and when this was mentioned, the teachers stated 
that, about month before the interpretations the tests were 
reported, these students had been guided into other courses 


study which the advisers thought would provide more suitable 
environments for them. 


lengthy written reports sent parents—the most 
recent ones being only two weeks old the time—were 
examined, and these were found agree highly with the writ- 
er’s summaries based test records. seemed able not only 
select cases high achievement and low achievement, but 
describe students who might termed “mediocre.” How- 
ever, student seemed merit that particular designation 
after analysis had been made all his tests, for although 
might have been regarded mediocre when judged 
test scaled for numerical score, the present tests such 
variety behaviors was called for, that had chance 
demonstrate competence, attitudes, interests, appreciations 
many different fields. This resulted collection data 
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which made possible for one who would examine individ- 
ual’s test results describe him somewhat greater detail and 
make more comprehensive picture him expressed the 
common purposes the school. After the writer had described 
student from his test results, the teachers frequently said 
that they had nothing add that picture and that repre- 
sented what they themselves might have written about that 
particular student. This not surprising because the tests had 
been designed measure certain specific purposes which these 
teachers held important, and the sharpness the descrip- 
tions made the writer was possible only because the tests 
had been carefully designed give evidence those particular 
points. 

trying sketch the individual his test results, his 
scores were compared with the median his particular group.” 
This was done for each aspect the test; then the total pattern 
his achievement was contrasted with the general pattern 
shown the median scores the group. When something 
significant could said about the student, this was jotted down 
his individual summary sheet. When this was done for each 
the ten tests, body material was available from which 
inferences about his achievement could drawn. 

There also were available the student’s scores the Ameri- 
can Council Psychological Examination, Iowa Silent 
Reading Test, and other personal information collected 
personality questionnaire devised the teachers the school. 
Naturally, when this wealth material was studied carefully 
and inferences were drawn from these reliable, valid data, 
picture individual emerged which was more comprehen- 
sive than possible the ordinary testing program. 


all this considered, course, not all sur- 
prising that teachers’ judgments and the judgments 
interpreter the test records should agree. What more 
surprising, perhaps, that those who have been identified 
with secondary education have not seriously considered other 
aspects the development our students than that which 
deals solely with the acquisition information—important 


does not imply that student’s pattern achievement should compared 
with the median score his group. Obviously should like describe student 
terms own growth; this was not possible the present time because previous data 
relative these different abilities were not available. 
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though is. the past, many may have been somewhat 
frightened the staggering task administering many tests, 
correcting all the papers, tabulating all the results, and 
then interpreting the data. Recently, however, scoring ma- 
chine has been perfected which makes possible for students 
record their responses separate answer sheets, which can 
scored mechanically. the offices the Progressive Edu- 
cation Association, Page Hall, Ohio State University, such 
machine almost constant operation daily. have found 
easy matter score more than five hundred papers 
hour, and recently have made use supplementary device 
which makes possible secure quadruplicate copies the 
results each group students who take the test immediately 
after the last paper has been put through the machine. This 
enormously reduces the cost testing program, and de- 
creases the time which necessarily intervenes between the ad- 
ministration test and its use teachers their day-by-day 
activities. [Vol. XVII, No. 
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